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Education is a pivotal pillar in modern society, and technology has brought 
about major changes in how students learn. Online learning is becoming an 
increasingly popular form of education, especially since the coronavirus 
disease (COVID-19) pandemic broke out. However, the challenge of 
maintaining student engagement and motivation in online learning 
environments remains a concern for many educators. This is where the 
concept of gamification erupts as an innovative solution to this problem. 
This study aimed to examine the effect of case and project-based 
gamification models on student engagement and academic achievement in 
online learning in tertiary institutions. Quasi-experimental post-test only 
non-equivalent control group design was chosen as the method of this 
research. The subjects of this study were 117 students from Universitas 
Pendidikan Ganesha. The instrument used to measure student engagement 
was a questionnaire developed by researchers with reference to the online 
student engagement (OSE) indicator; meanwhile, an objective test was to 
assess student academic achievement. The data were analyzed using a one- 
way multivariate analysis of variance (MANOVA) technique. The study 
results show significant differences in student engagement and academic 
achievement between groups of students taught using case and project-based 
gamification models and direct e-learning models. Case and project-based 
gamification models used in online learning were effective in increasing 
student engagement and student academic achievement. 
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1. INTRODUCTION 


It has been argued that traditional learning approaches are unattractive and ineffective for gen-Z 
students [1]. They have different ways of processing and understanding information, enjoy the concept of 
teamwork and collaborative activities in learning, and become skilled, social, and energetic compared to 
previous generations [2]. Understanding the characteristics of students in this category has encouraged many 
researchers to design appropriate activities supporting their learning processes [3]. 

The use of information and communications technology (ICT) in learning, such as online learning, 
is increasing, especially during the recent coronavirus outbreak that hit the world [4], [5]. Teachers uploaded 
content and managed learning activities using various learning management system technologies such as 
Moodle [6], Google Classroom [7], WebQuest [8], Edmodo [9], Schoology [10], and various other non 


Journal homepage: http://edulearn.intelektual.org 


J Edu & Learn ISSN: 2089-9823 Oo 977 


learning management system (LMS) platforms [11]. However, the factor of teacher unpreparedness in 
designing and implementing interesting online learning was suspected to be the cause of the emergence of 
various problems in most parts of the world, including Indonesia [12]. 

Several problems were identified, such as theoretical, monotonous, and uninteresting learning 
materials [13], low learning interaction making students passive [14], students’ lost interest and focus in 
learning due to self-study [15], the absence of challenging teamwork activities causing students to be 
unenthusiastic [16], and inability to achieve learning objectives through online learning [17]. Some of these 
obstacles can be used as a reference to find an innovative solution that can make online learning more 
interesting, challenging, fun, and meaningful for students. Learning that is fun and permeates students’ daily 
lives is an important part of the student development [18]. Student engagement refers to the level of 
involvement, participation, and interest that students have in their learning and educational activities [19]. It 
is important for several reasons including academic success, motivation, retention, preparation for the future, 
overall well-being, and societal impact [20]. Pedagogical aspects such as interest, intention, motivation, 
and attitude are important in the behavior and involvement of students in the online learning [21]. These 
aspects can be improved through the provision of richer content/teaching materials [22], adaptive and 
challenging learning strategies or steps [23], and a learning environment that can improve student learning 
performance [24]. 

How to motivate and involve students in online learning is one of the biggest challenges in this 
digital era. Playing digital games is a hobby and routine among today’s youth and adults in various regions 
[25]. Students generally do not like to do their daily learning tasks online for a long time but are willing to 
spend many hours playing games [26]. Efforts are needed to make delivery of material and learning activities 
that combine pedagogical principles with games [27]. The utilization of game elements (gamification) can be 
applied to motivate, entertain, and attract students so that learning objectives are still achieved [28]. 
Gamification has attracted much attention as a key aspect of underlying pedagogy that can increase student 
engagement and motivation in the learning [29]. The use of gamification in online learning is developing and 
increasingly popular [30]. 

Gamification as an implementation or practice of modern educational theory aims to maximize 
student satisfaction, motivation, success rate, and ability. This modern theory contains effective learning, 
which suggests that learning is most effective when it is challenging, fun, active, collaborative, skill-based, 
and incident/case-based [31]. Several active learning methods can be combined with game elements [32], 
[33]. Active or student-centered learning methods include the case method [34] and the team-based project 
learning method [35]. The case method is a constructivist learning approach in which real problems close to 
students’ lives are presented in the learning [36]. Ali et al. [37] stated that the case method provides 
opportunities for students to: i) analyze cases and content, ii) increase exploratory knowledge by 
independently finding information, data, and literature, iii) improve critical thinking by solving the cases 
provided, iv) achieve better collaboration by finding answers that are discussed together, and v) increase 
opportunities to receive feedback through presentations and improvements. Cases presented in learning 
contain problems related to the environment, conditions, situations, or a picture of students’ future [38]. 

Game elements can also be applied to project-based learning stages [39]. Project-based learning 
provides opportunities for students to explore, assess, interpret, synthesize, and information to produce 
various forms of learning outcomes [40]. Through this model, students carry out an in-depth investigation of 
a topic collaboratively and constructively to deepen learning with a research approach to problems and 
questions that are weighty, real, and relevant [41]. Collaborative and gamified online learning can generate 
positive emotions as motivation for students [42]. 

Designing and implementing gamification methods in the context of active (case-based and project- 
based) online learning is different from teaching in a (face-to-face) classroom, where lecturers usually easily 
manage students directly [43]. However, using the LMS technology, gamification in online learning can be 
developed [29], [44]. Research by Paľová and Vejatka [45] shows the benefits of an LMS that allows 
lecturers to easily send lesson plans, announcements, and assignments, create learning paths, provide 
feedback, give badges, distribute quizzes, and make interactions. LMS Moodle can increase student 
involvement in learning outside the classroom (online) and has a positive influence on student activity, 
motivation, thinking skills, and innovation [46]-[49]. 

In addition, after Moodle LMS is configured, it is possible to plan badges or awards that students 
can win after completing activities in the LMS. Besides, Moodle LMS has more functions that can be 
optimized in producing gamification in online learning. According to [50], some of the gamification 
implementations that can be done on the Moodle LMS are: i) giving points to students after accessing 
learning resources and completing activities/assignments, ii) providing various badges as a reward to students 
for the achievements obtained, iii) sending certificates and awards after completing all learning, iv) re- 
certifying at a certain time, v) displaying leaderboards in chart and diagram format, and vi) displaying the 
entire level to be achieved. 
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Moodle LMS offers various features that facilitate the gamification process in online learning; 
however, experience is still required to incorporate these features into existing learning materials and 
activities. In this regard, researchers have designed, developed, and validated the design of a gamification 
model in case and project-based online learning [51]. Furthermore, it is necessary to apply this model in 
experimental research to determine the effectiveness of this model in increasing student engagement and 
academic achievement. This research provides theoretical contributions in the form of alternative solutions to 
various problems that have arisen from online learning practices so far through the implementation of online 
learning model designs by applying game elements in active learning, especially the case method and project- 
based learning in tertiary institutions. The hypotheses (H1) were formulated for this study: i) there is a 
significant difference in student engagement between students taught using the case and project-based 
gamification model and those taught using the direct e-learning model and ii) there is a significant difference 
in student academic achievement between students taught using the case and project-based gamification 
model and those taught using the direct e-learning model. 


2. METHOD 
2.1. Research design 

This research is experimental research that examines the effect of independent variables on the 
dependent variable. The independent variable in this study is the learning model, while the dependent 
variables are student engagement and academic achievement. Quasi-experimental posttest-only control group 
design by Shadish and Luellen [52] was used in this study to compare the treatment between the two groups, 
namely the experimental group and the control group. The experimental group applied special treatment, 
implementing a case and project-based gamification model. Meanwhile, the control group did not receive 
special treatment and only used the model that has so far been commonly applied in direct e-learning. The 
planning of this research can be seen in the Table 1. Where X: treatment (using case and project-based 
gamification models); -: did not receive treatment (using direct e-learning); 01: posttest of student engagement 
of the experimental group; 02: posttest of academic achievement of the experimental group; 03: posttest of 
student engagement of the control group; 04: posttest of academic achievement of the control group. 


Table 1. Research design 


Group Treatment _ Posttest 
Experiment X 01 02 
Control - 03 04 


2.2. Participants 

The subjects of this study were students from various educational study programs at the Universitas 
Pendidikan Ganesha, Indonesia. They are enrolled in the teaching materials development course where this 
course is a cross-program course in the even semester of the 2022/2023 academic year. A total of 117 
students were divided into four classes (two classes were experimental classes, while the other two classes 
were control classes). The experimental class consisted of 64 students: 23 boys and 41 girls, while the control 
class consisted of 53 students: 20 boys and 33 girls. The experimental class and the control class were 
determined using a random class sampling technique, assuming that all subject classes were homogeneous 
after the class equivalence test was carried out. 


2.3. Procedures 

The researcher conducted direct research on the class designated as the experimental class and the 
other class as the control class. In the experimental class, the researcher implemented a case and project- 
based gamification model; meanwhile, in the control class, the researcher implemented the direct e-learning 
model. Prior to implementing the learning model, researchers conducted measurements on student 
engagement and academic achievement for the two research subject groups simultaneously. This enabled the 
researcher to see how far the level of student engagement and academic achievement was before the 
experiment. Then the researcher carried out learning activities for the experimental class and the control 
class. 

In the experimental class, the case and project-based gamification model was applied to the course, 
i.e., the development of teaching materials. In this case, the role of the researcher was only as a facilitator. 
Students built their activeness, involvement, and knowledge according to the principles and stages of the 
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model applied. The case and project-based gamification learning in teaching material development courses 


follows the structure of the designed model as shown in Figure1. 
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Figure 1. The structure of the case- and project-based gamification model in online learning 


Figure | shows the structure of the model design that has combined aspects of pedagogy and 
technology. The gamification strategy was applied to the teaching materials development course, a cross- 
study course in general education programs for undergraduate degrees. Activities and resources in the e- 
learning course refer to the stages of the case methods method with the steps: i) defining cases, ii) analyzing 
cases, iii) independently finding information, data, and literature, iv) determining the completion steps of 
cases that have been provided, v) making conclusions from the answers discussed together, vi) making 
presentations, and vii) making improvements. Furthermore, the method of the project based consists of the 
steps: i) formulating the expected learning outcome, ii) understanding the concept of the teaching materials, 
iii) conducting skills training, iv) designing the project theme, v) making the project proposal, vi) executing 
the tasks of the project, and vii) presenting the project report. 

Moodle LMS platform was used to build a gamification strategy for all stages of case and project- 
based learning models by adding game elements. Researchers installed Moodle version 3.2, including the 
“level up!” block, an additional plug-in for gamification (https://moodle.org/plugins/block_xp), on the web 
server. Researchers used the basic Moodle activities and resources module for the site to manage courses. 
Moodle’s built-in gamification features and “level up!” blocks were applied to build gamification elements. 
The built-in and additional features of this system were also implemented to build game elements, such as 
experience points (XP), levels, badges, leaderboards, and progress bars used at each step of case and project- 
based learning. 

Meanwhile, for the control class, learning activities were carried out using the direct e-learning 
model. In this learning model, the students obtained main course and enrichment materials, accessed the 
assignments, and sent answers to lecturers. The learning materials/topics were the same in both classes, 
focused on developing teaching materials. After all the learning stages were carried out on the two learning 
models, the researcher gave student engagement questionnaires and learning achievement tests at the end of 
the lesson to determine the success rate of these models in learning. 
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2.4. Instruments 

To get the right research data, quality instruments were needed to explore what was desired. 
Activities carried out by researchers to obtain instruments that have good quality are: i) document analysis, 
ii) manufacture of specifications table (lattice), ii) consultation with experts (materials and media), 
iv) consultation with colleagues, v) instrument writing, vi) instrument validation, and vii) instrument trial. 
Student engagement instruments were developed by researchers referring to online student engagement 
indicators by Dixson [53], including i) skills, ii) emotions, iii) participation, and iv) performance. This 
instrument consists of 25 questions in a questionnaire prepared using a Likert scale. The student engagement 
score for each student was calculated by the formula (actual score: ideal score) x 100%. The outline of the 
student engagement questionnaire is shown in the Table 2. 


Table 2. Outline of the student engagement instruments 


Skill Emotion Participation Performance 
1. Study regularly 1. Put forth effort 1. Have fun in online chats, discussions or via email 1. Do well on 
2. Staying up on reading 2. Find ways to make with the instructor or other students tests 
3. Look over class notes materials relevant 2. Participate actively in forums 2. Get good 
4. Be organized 3. Apply to my life 3. Help fellow students grades 
5. Listen/read carefully 4. Find ways to make 4. Engage in online conversations 
6. Take good notes over material interesting 5. Post regularly in forum 

readings, PPT, Video 5. Really desire to learn 


Learning achievement instruments aim to measure factual, conceptual, principle, and procedural 
mastery/knowledge regarding the conception of teaching materials, steps in developing teaching materials, 
and the ability to evaluate formative and summative teaching materials. The learning achievement instrument 
used is an objective test (multiple choice) with one correct answer. The total number of questions is 50 items 
with 5 options/choices. Score | is given if the answer is correct, and score 0 is given if the answer is wrong. 
The amount of each student’s learning achievement score was calculated by the formula (actual score: ideal 
score) X 100%. The lowest score will get 0, and the highest score will get 100. 

Both instruments have gone through expert validation and have been tested on 90 students. From the 
calculation of the corrected item to the total correlation validity of the items/statements on the student 
engagement questionnaire, it can be explained that the 25 student engagement instrument items were in the 
range of 0.261 to 0.676, and the 50 learning achievement instrument items were in the range 0.211 to 0.608. 
Therefore, they have fulfilled the validity test requirements because each item has a total item correlation 
value greater than the r table value (0.207). Thus, both instruments could be used in collecting research data. 

Furthermore, the level of reliability was tested with the alpha coefficient (alpha Cronbach). The 
instrument is considered eligible if it has a high level of reliability. The interpretation of the reliability 
coefficient in this case refers to Allen et al. [54], namely: very high (0.80 to 1.00), high (0.60 to 0.79), 
moderate (0.40 to 0.59), low (0.20 to 0.39), and very low (0.00 to 0.19). From SPSS calculation, the 
reliability of student engagement instrument with 25 items obtained a Cronbach alpha value of 0.904. 
Furthermore, the reliability of the learning achievement instrument with 50 items obtained Cronbach’s alpha 
value of 0.907. When referring to the interpretation of the reliability coefficient as mentioned by Allen et al. 
[54], it can be seen that the reliability of the student engagement questionnaire with 25 items and the 
reliability of the learning outcomes test with 50 valid items are included in the very high category, and this 
means that the reliability is acceptable for use in research. 


2.5. Data analysis 

Data analysis techniques are divided into two parts. The first part is data analysis to test the analysis 
requirements, and the second part is data analysis to test the research hypothesis. Analysis requirements 
include data normality tests and data homogeneity tests, while hypothesis testing uses multivariate analysis of 
variance (MANOVA) tests. 


2.5.1. Requirements analysis test 

To test the analysis requirements, the data normality test and variance homogeneity test were carried 
out. The data normality test used the Kolmogorov-Smirnov technique, while the variance homogeneity test 
used the Levene test. The data normality test and variance homogeneity test were used to fulfill all parametric 
assumptions. 
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2.5.2. MANOVA test 

Analysis to test the research hypothesis was carried out using MANOVA, referring to Kerlinger and 
Lee [55]. MANOVA is a statistical technique used to calculate the significance test of the mean difference 
simultaneously between groups for the two dependent variables. This technique is useful for analyzing the 
dependent variable with interval and ratio scales. In this study, the dependent variable is student engagement 
and learning achievement. MANOVA analysis technique in this study used SPSS program with a 
significance level of æ = 0.05. The decision is determined if the sign value >0.05, then Ho is accepted; while 
if the sign value <0.05, then Ho is rejected. 


3. RESULTS 
3.1. Description of research results data 
3.1.1. Description of data on student engagement and academic achievement measurement results 
before treatment 

The recapitulation of the results of measuring student engagement and academic achievement before 
treatment is shown in the Table 3. Table 3 shows that students in the experimental class obtained a score of 
66.16 with a standard deviation of 4.14 on the average initial student engagement score. Moreover, the test 
on learning achievement obtained a score of 60.08 with a standard deviation (Std. dev) of 6.82. Meanwhile, 
students in the control group scored 66.25 on average initial student engagement with a standard deviation of 
3.95 and an average learning achievement test score of 60.34 with a standard deviation of 6.53. 


Table 3. Student engagement dan academic achievement before treatment 


Group Student engagement Academic achievement 
Average Std. dev Average Std. dev 
Experimented class 66.16 4.14 60.08 6.82 
Controlled class 66.25 3.95 60.34 6.53 


Therefore, there is no significant difference shown in student engagement and learning achievement 
between students in both the experimental and control classes. This illustrates that the ability of the research 
subjects before the study was not significantly different. The results in Table 3 were then analyzed using an 
independent sample t-test to understand how significant student engagement and initial learning achievement 
were before the case and project-based gamification models were implemented in the experimental class and the 
direct e-learning model in the control class. The results of the analysis of differences in student engagement 
and student achievement before being taught using the two models are presented in Tables 4 and 5. 


Table 4. Result of the t-test of initial student engagement and academic achievement pretest 


Learning model N Mean Std. deviation Std. error mean 
Student engagement Experimented class 64 66.16 4.141 .518 
Controlled class 53 66.25 3.951 .543 
Academic achievement Experimented class 64 60.08 6.827 .853 
Controlled class 53 60.34 6.531 .897 


The SPSS output on group statistics, as presented in Table 4, shows that 64 students obtained an 
average student engagement score of 66.16 in the experimental class. 53 Students obtained an average of 
66.25 in the control class. Furthermore, the average values of academic achievement are 60.08 in the 
experimental class and 60.34 in the control class. Table 5 shows Sig Levene’s Test scores of 0.737 in student 
engagement and 0.663 in academic achievement. Both significance values are greater than 0.05, meaning 
there was no difference in the variance of initial student engagement scores and learning achievement 
(pretest) between the experimental and the control classes. Therefore, the test can be carried out using an 
independent t-test assuming homogeneous data (assuming variance is the same). The t-test results for the 
initial student engagement scores between the experimental class and the control class showed a significance 
value of 0.906 (p>0.05, Ho is accepted), meaning that there was no significant difference in the initial student 
engagement scores between the two classes. Moreover, the independent t-test for learning achievement 
scores (pretest) between the experimental class and the control class obtained a significance value of 0.834 
(p>0.05, Ho is accepted), meaning that there was no significant difference in learning achievement (pretest) 
between the two classes. In other words, before treatment with the application of case and project-based 
gamification models and direct e-learning models, student engagement and student learning achievement in 
the experimental and control classes were not significantly different or relatively the same. 
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Table 5. Independent sample test 
Levene’s test for 
equality of T-test for equality of means 
variances 


95% confidence 
Mean Std. error interval of the 


5 Sig. t di, eee a) difference difference difference 
Upper Lower 
Student Equal variances 113 .737 -.118 115 .906 -.089 .753 -1.581 1.403 
engagement assumed 
Equal variances -.119 112.677 .906 -.089 .750 -1.575 1.397 
not assumed 
Academic Equal variances 190 .663 -.210 115 834 -.261 1.243 -2.724 2.201 
achievement assumed 
Equal variances -.211 112.594 .833 -.261 1.238 -2.715 2.192 


not assumed 


3.1.2. Description of data on student engagement and academic achievement measurement results after 
treatment 

The results of measuring student engagement and academic achievement show students’ scores on 
the student engagement questionnaires and academic achievement tests after the students taught using case 
and project-based gamification models and direct e-learning learning models. The student engagement and 
academic achievement scores after the treatment are presented in the Table 6. Table 6 shows that in the 
experimental class, the average student engagement score was 90.53 with a standard deviation of 4.313, and 
academic achievement reached an average of 86.92 with a standard deviation of 4.671. As for the group of 
students in the control class, the average student engagement score was 79.47 with a standard deviation of 
3.603, and academic achievement reached an average of 75.70 with a standard deviation of 5.297. A clearer 
description of student engagement scores and student academic achievement in teaching material 
development courses based on the applied learning model (case and project-based gamification model and 
direct e-learning model) for students is presented in Figures 2 and 3. 


Table 6. Student engagement dan academic achievement after treatment 


Group Student engagement Academic achievement 
Average Std. Dev Average Std. Dev 
Experimented class 90.53 4.313 86.92 4.671 
Controlled class 79.47 3.603 75.70 5.297 


3.2. Analysis requirements testing 

Analysis requirements testing determines parametric feasibility before testing the hypothesis. The 
analysis requirements testing for the multivariate test consists of a normality test and a homogeneity test. The 
presentation is preceded by testing requirements analysis or testing assumptions, then followed by hypothesis 
testing activities. 


3.2.1. Data normality test on student engagement and academic achievement based on the learning 
model 

Kolmogorov-Smirnov statistical test at a significance level (a) of 0.05 was used to test the normality 
of data for each treatment group. This test determines the normality or symmetry of the distribution of scores 
as a unit of analysis, namely student engagement scores and student academic achievement in teaching 
material development courses. The null hypothesis (Ho) in the data normality test states that the sample 
comes from a normally distributed population. If the significance or probability value is less than 0.05, the 
data distribution is not normal. Meanwhile, if the significance or probability value is more than 0.05, the data 
distribution is normal. The results of the normality test for student engagement and student academic 
achievement data in the teaching material development course with the case and project-based gamification 
model and the direct e-learning model are presented in the Table 7. 

Table 7 shows that the student engagement scores in the experimental and control classes obtained a 
significance value (probability) of 0.066 and 0.067 (>0.05). Likewise, with the value of academic 
achievement, the output table for statistical test results with SPSS shows that the significance value 
(probability) was 0.200 (>0.05) for the experimental class and 0.073 (>0.05) for the control class. Therefore, 
the final grades of student engagement and academic achievement in the experimental and control classes 
were normally distributed. 
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Figure 2. Histogram of student engagement in groups of students taught using the case and project-based 
gamification models and direct e-learning based on average scores, lowest scores, highest scores, and 
standard deviation 
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Figure 3. Histogram of academic achievement in groups of students taught using the case and project-based 
gamification models and direct e-learning based on average scores, lowest scores, highest scores, and 
standard deviation 


Table 7. Data normality test results 
Kolmogorov-Smirnov 
Learning model (a) 
Statistic df Sig. Statistic df Sig. 
Student engagement Experimented class 107 64 066 971 64 .132 


Shapiro-Wilk 


Controlled class .117 53 .067 .975 53 .319 
Academic achievement Experimented class .081 64 .200(*) .974 64 .190 
Controlled class .116 53 .073 .965 53 .116 


* This is a lower bound of the true significance. 
a Lilliefors Significance Correction 


In the Shapiro-Wilk test, student engagement scores in the experimental and control classes show a 
significance value (probability) of 0.132 and 0.319 (>0.05). Likewise, with the value of academic 
achievement, it indicates that the significance value (probability) was 0.190 (>0.05) for the experimental 
class and 0.116 (>0.05) for the control class. This means that the final scores for student engagement and 
academic achievement in the experimental and control classes were normally distributed, and they can 
proceed to the MANOVA test. 


3.2.2. Result of homogeneity test on student engagement and academic achievement 

The homogeneity test aims to know whether the variance values in the sample groups are 
homogeneous. In this study, a homogeneity test was conducted to determine whether the individual student 
engagement and academic achievement variant values were homogeneous between the treatment groups. To 
detect the presence or absence of heterogeneity, according to M. E. O’Neill and K. Y. Mathews [56], a test of 
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similarity of variance or homogeneity of variance-covariance, namely the Levene test (Levene test of 
homogeneity of variance), is used. Testing the homogeneity of sample variants with Levene’s has a 
significance level 0.05. If the significance is more than 0.05, it can be concluded that Ho is accepted, meaning 
the sample is homogeneous. The results of testing the sample variation with the Levene’s test using the SPSS 
program are presented in the Table 8. 


Table 8. Data homogeneity test results 
Levene’s test of equality of error variances (a) 


F dfl df2 Sig. 
Student engagement 1.825 1 115 .179 
Academic achievement .810 1 115 .370 


Tests the null hypothesis that the error variance of the dependent variable is equal across groups 
a design: intercept+learning_model 


Table 8 shows the significance value of the student engagement data obtained a significance value 
of 0.179 (p>0.05), so the variance or variance of the student engagement data is considered homogeneous. 
Likewise, academic achievement data obtained a significance value of 0.370 (p>0.05), so the variance of 
academic achievement data is homogeneous. In this case, the variance-covariance matrix of the dependent 
variable, namely the student engagement and academic achievement values, are the same for the existing 
groups (independent variables). Like ANOVA, MANOVA output can be interpreted properly if the variance- 
covariance matrix of the dependent variable is relatively the same in each independent group. The results of 
the normality and homogeneity tests show that the data were normally distributed and homogeneous. 
Therefore, testing the MANOVA analysis could be carried out because the assumptions of normality and 
homogeneity of the variety of data had been met. 


3.3. Description of the MANOVA analysis results 

The results of calculating the MANOVA analysis technique at a significance value of 0.05 are 
presented in the Table 9. Table 9 shows that the learning model obtained significant value tested by Pillai’s 
Trace, Wilks’ Lambda, Hotelling’s Trace, and Roy’s Largest Root procedures. All procedures showed a 
significant value of 0.000, which was less than an alpha of 0.05 (p<0.05). Thus, Ho is rejected, meaning that 
student engagement and academic achievement had differences in the two learning models. Based on 
questionnaires and posttest scores, student engagement and academic achievement of students taught using 
the case and project-based gamification model were proven to have higher scores than student engagement 
and academic achievement of students taught using the direct e-learning model. 


Table 9. Results of multivariate test analysis 
Multivariate tests (b) 


Effect Value F Hypothesis df __Error df Sig. 
Intercept Pillai’s trace 998 29278.546(a) 2.000 114.000 .000 
Wilks’ lambda 002 29278.546(a) 2.000 114.000 .000 

Hotelling’s trace 513.659 29278.546(a) 2.000 114.000 .000 

Roy’s largest root 513.659 29278.546(a) 2.000 114.000 .000 

Learning_model Pillai’s trace .693 128.402(a) 2.000 114.000  .000 
Wilks’ lambda 307 128.402(a) 2.000 114.000 .000 

Hotelling’s trace 2.253 128.402(a) 2.000 114.000 .000 

Roy’s largest root 2.253 128.402(a) 2.000 114.000 .000 


a Exact statistic 
b Design: intercept+learning_model 


Therefore, the results of individual tests on the independent and dependent variables (test of 
between-subject effect MANOVA) using MANOVA are presented in the Table 10. Table 10 shows that 
student engagement obtained an F value of 220.771 with a significant level of 0.000, which was less than the 
alpha of 0.05. Thus, Ho is rejected, meaning that there was a significant difference in student engagement 
with the use of case and project-based gamification models and direct e-learning models. Furthermore, it can 
be illustrated that academic achievement obtained an F value of 148.210 with a significant level of 0.000, 
which was less than the alpha of 0.05. Thus, Ho is also rejected, meaning that there is a significant difference 
in academic achievement among students taught using the case and project-based gamification model and the 
direct e-learning model. 
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Table 10. Result of tests of between-subjects effects 


Source Dependent variable Type M sum of squares df Mean square F Sig. 
Corrected model Student engagement 3,546.052(a) 1 3,546.052 220.771 .000 
Academic achievement 3,652.135(b) 1 3,652.135 148.210 .000 
Intercept Student engagement 837,882.052 1 837,882.052 52,165.062 .000 
Academic achievement 766,686.529 1 766,686.529  31,113.557  .000 
Learning model Student engagement 3,546.052 1 3,546.052 220.771 .000 
Academic achievement 3,652.135 1 3,652.135 148.210 .000 
Error Student engagement 1,847.145 115 16.062 
Academic achievement 2,833.779 115 24.642 
Total Student engagement 861,120.000 117 
Academic achievement 790,08 1.000 117 
Corrected total Student engagement 5,393.197 116 
Academic achievement 6,485.915 116 


a R squared=.658 (adjusted R squared=.655) 
b R squared=.563 (adjusted R squared=.559) 


4. DISCUSSION 

This study examines the effect of case and project-based gamification models on student 
engagement and academic achievement in online learning for college students. The study results show a 
significant difference between student engagement and academic achievement of students taught using the 
case and project-based gamification and direct e-learning models. Student engagement and academic 
achievement of students taught using the case and project-based gamification model were better than students 
taught using the direct e-learning model. The difference in student engagement and academic achievement 
between the two groups of students shows that student engagement and academic achievement are influenced 
by the learning model, even though students are given the same subject matter, questions, and facilities. 

Student engagement is characterized by student involvement in in-depth learning activities, 
understanding and self-regulation, positive reactions to the learning environment, peers and teachers, interest 
and a sense of belonging, persistence, and positive behavior [57]. Students are involved in learning when 
given an appropriate learning environment according to their learning styles, learning modalities, and 
learning preferences [58]. In this study, the gamification model was used for case-based learning media 
courses and online projects. This research combines various learning approaches/methods (cases and 
projects) with various learning resources or learning media (documents, animations, videos, and multimedia), 
various activity formats and interactions between teachers and students, and game elements in every step of 
learning activities. 

In the case-based learning process, students are given the opportunity to find the essence of the 
subject matter independently rather than just listening to the teacher’s verbal explanation. Sanjaya et al. [59] 
emphasized that the case-based learning method allows students to solve problems that are relevant to the 
topics they are studying. Students participate actively in various sources of information into context, and they 
try to solve cases using their previous knowledge and experience. In this scenario, the steps of the case-based 
learning method include i) establishing cases, ii) analyzing cases, iii) finding information, data, and literature 
independently, iv) determining what steps must be taken to resolve the cases provided, v) making 
conclusions from answers discussed together, vi) making a presentation, and vii) making improvement. 
Several topics of lecture material, such as the position of teaching materials, selection of teaching materials, 
and use of teaching materials, were studied by students with the case-based learning method. These topics 
cover realistic problems and include problems related to the environment, conditions, situations, and pictures 
of students’ futures. The case-based learning method emphasizes the role of students as learning subjects by 
seeking, finding, connecting, and applying ideas in a representative manner in a low-risk environment [60]. 
Case-based learning model can increase students’ self-confidence, critical thinking skills, problem-solving 
skills, teamwork, and cultural awareness [61]-[64]. Moreover, case-based learning has many other 
advantages, such as: i) students can associate what they know with the problems they are currently facing, 
and ii) students have a chance to consider problems similar to those they face in the real world [65]. 

Furthermore, other learning topics such as analysis of the needs of teaching materials, design of 
teaching materials, production of traditional and digital teaching materials, and evaluation of teaching 
materials were studied using the project-based learning method. The topic of lecture material is very relevant 
to be studied by students with the team-based project learning method because it can provide hands-on 
experience in a collaborative manner and present learning that is not limited to mere (cognitive) knowledge. 
In this scenario, the steps of the project-based learning method include: i) formulating the expected learning 
outcome, ii) understanding the concept of the teaching materials, iii) conducting skills training, iv) designing 
the project theme, v) making the project proposal, vi) executing the tasks of the project, and vii) presenting 
the project report. Guo [66] stated that the project-based learning method gives students more freedom, 
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engagement, and responsibility for learning. Project-based learning method at each stage improves students’ 
critical thinking skills, starting with the stage of selecting projects that are tailored to students’ needs. After 
the planning stage, which begins by looking at what they already know, such as organizing and asking 
questions, students can learn more about the activities built into project-based learning strategies. 
Furthermore, the project-learning method teaches skills in recognizing assumptions, assessing arguments 
through class discussions, running projects, collecting and analyzing data, and presenting project reports. 
During the project-based learning stage, students can connect their experiences with the real world and 
encourage them to think critically when they acquire new information [67]. Collaborative online learning 
projects can increase student involvement and ability to complete their assignments [16]. 

Each stage of the case-based and project-based learning methods uses game elements. Various 
available gamification tools were added to the LMS using a plugin. LMS is a suitable place for gamification 
for having the ability to automatically record digital statistics of students’ results and progress in the 
gamification-based learning [68]. LMS makes it possible to collect data on how much time students spend 
viewing and interacting with the material provided. Several settings can be enabled in the LMS to encourage 
students to participate in discussions, forums and blogs, as well as participate in the development of learning 
content by creating Wiki pages. Moodle LMS application promotes several advantages, such as: i) being able 
to choose various formats of available learning activities, such as the weekly format, or also being able to use 
topic and social formats, ii) being able to be more flexible in determining activities learning, such as 
communities, journals, quizzes, choice questions, surveys, assignments, and chat, iii) all class members both 
in forums, journals, quizzes, and assignments can be seen on one page (and can be downloaded as a 
spreadsheet file), and iv) being able to display various user activities [58]. In e-learning course material 
development, built-in and additional features of the Moodle LMS are used to create game elements such as 
XP, levels, badges, leaderboards, and progress bars. 

Students receive XP automatically after completing certain tasks and actions in learning, such as 
logging into the system, posting on forums, and accessing reading material pages. This number of XP can 
attract, encourage, and increase student engagement and academic productivity [69], [70]. Levels connect 
student XP related to their activities. This feature notifies students when they level up [71]. The main purpose 
of using the level up block is to provide incentives for students to follow and complete their learning 
experiences and motivate them to complete their learning activities [72]. Badges are given to students as a 
reward for their achievements, including “active”, “hard work”, and “champion” badges given out for 
activities that students have completed. In addition, these badges function as social markers because other 
students can see them in public [73]. This will have an impact on student behavior to always be the best in 
class [74]. 

Leaderboards provide a visual representation of students’ rankings in the class. Students like this 
feature because it can help them concentrate on setting personal goals for subsequent learning activities [75]. 
They also prefer to see their top peers on leaderboards to determine the range of their performance and those 
of other excellent peers [76]. In addition, progress bars can show how far a student has progressed in their 
learning. It can also provide feedback to students to improve their efforts to learn. Progress bars are well 
received and considered a tool for managing individual learning strategies. They allow flexible learning for a 
wide range of students [77], [78]. 

An effective online learning environment must be able to encourage student activity in a pleasant 
atmosphere. The design of case and project-based gamification models in online learning can be an option in 
current teaching and learning activities. Game techniques and mechanisms implemented in case and project- 
based learning processes are proven to be able to achieve learning objectives, increase student engagement, 
and increase student motivation and involvement in a challenging, fun, friendly collaborative learning 
environment. 


5. CONCLUSION 

This study examines the effect of case and project-based gamification models on student 
engagement and academic achievement in online learning for college students. The study results found that 
the case and project-based gamification models used in online learning had a significant effect on student 
engagement and academic achievement scores. Thus, case and project-based gamification models in online 
learning have advantages over direct e-learning models in achieving/increasing student engagement and 
academic achievement. Case and project-based gamification models in online learning by integrating game 
elements and techniques in each learning stage have created student activity and strengthened positive 
learning behavior, maximizing feelings of enjoyment and engagement in the learning process. 
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6. RECOMMENDATION 

Referring to the results of the study and discussion, several recommendations are proposed in this 
research. Case and project-based gamification models in online learning can be implemented in other tertiary 
institutions which have students with the same characteristics as the subject of this study. Case and project- 
based gamification models in online learning can also be implemented in other courses with similar 
characteristics to the subjects studied in this study. For students taught using this learning model for the first 
time, the lecturer should provide directions, especially on how to view, access, and utilize LMS features that 
provide game elements. To be further developed and used by many people, especially related to efforts to 
involve students in learning and improve their learning achievement, the design of this model can be 
disseminated through academic seminars, training on the development and use of learning models, 
collaboration with educational institutions and training, and other forums. It is necessary to pursue further 
research activities to apply this model to other target characteristics at different levels, pathways, and types of 
education. In managing learning, lecturers are advised to use a learning model that is more oriented to student 
characteristics, fun like gamification and active like the case and project-based learning method. 


7. LIMITATION 

The application of case and project-based gamification models in online learning has several 
limitations. Implementation of this model requires ICT devices (computer devices or mobile devices), and 
also requires adequate internet access. Apart from that, the application of this model is only limited to 
teaching material development. The instrument for measuring student engagement is only limited to 
measuring primary data in the form of questionnaires. The testing carried out in this research did not reach 
the long-term impact evaluation stage. 
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